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The information that is currently collected on the 
nation *s postsecondary institutions focuses primarily on quantity, 
addressing the need for descriptive information on students, faculty, 
and finances. This type of research, though necessary, is not 
sufficient for an understanding of the broader accountability issues 
emerging in the 1980* s. Available data, when they do provide indices 
of student flow and outcomes, may grossly underestimate the 
institutional effectiveness of community, technical, and junior 
colleges. Many community colleges are attempting to gain a better 
understanding of their students by assessing: student educational 
objectives; the causes of student attrition and the extent to which 
it signifies student failure; and occupational and transfer outcomes. 
Sample research efforts in these four areas are briefly described in 
this review, including: (1) studies to determine student goals and 
intentions conducted at Glendale Community College (Glendale, 
Arizona) and Vista College (Berkeley, California); (2) follow-up 
studies of college dropouts c nducted in the Los Rios Community 
College District (Sacramento, California) and at Butler County 
Coamunity College (Butler, Pennsylvania) designed to disaggregate 
those who attained their goals from those who did not; (3) vocational 
follow-up research conducted at William Rainey Harper College 
(Palatine, Illinois) to determine vocational students* job attainment 
and the economic '^rate of return** on vocational studies; and (4) 
transfer outcome assessments conducted in the San Mateo County 
Community College District (San Mateo, California) and at Piedmont 
Virginia CommunHy College (Charlottesville, Virginia). (EJ^M 
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Assessing Institutional Effectiveness: 
Community College Case Studies 



Data collected on the nation's postsecondary institutions focus primarily on quantity, addressing the 
need for descriptive information on students, faculty, and finances. There are good reasons for this. 
Accurate data on the number of colleges established, the number of students enrolled, the number of 
faculty and staff employed, expenditures per student, and other indicators of magnitude are requisite to 
fiscal accountability. Such data also provide benchmark measures of the growth of higher education 
after the Second World War. 

But data collection efforts focusing on simple description, though necessary, are not sufficient for 
understandmg the broader accountability issues emerging in the 1980s. College leaders are increasingly 
called upon to verify institutional effectiveness, particularly in the areas of student learning and goal 
attainment. Information related to student flow and outcomes must be added to data on how many 
students are enrolled or how much is spent on instruction. Are students adequately prepared to continue 
their education, should they decide to do so? What do college graduates learn as a consequence of their 
undergraduate education? Does the college experience adequately prepare students for the workplace 
and for career mobility? Such questions - which are essential to telling the community college story 
— require data that provide longer-term assessments of institutional effects. 

Available data, when they do provide indices of student flow and outcomes, may grossly underestimate 
the institutional effectiveness of community, technical, and junior colleges. For example degrees 
a'varded are often used as the sole indicator of student outcomes. This reflects a bias toward four-year 
colleges and universities, where it is assumed that all enrolled students are matriculated into degree 
programs. At community colleges, on the other hand, experience has shown that many (perhaps most) 
students intend to fulfill vocational or transfer-related goals without earning a certificate or assoc-ate 
degree. A major challenge faced by community colleges, then, is to develop alternative measures of 
student progress and outcomes that more adequately reflect the varied educational goals of community 
college students. ' 

This challenge places a heavy burden on community college institutional research offices Each 
research question has its price tag, both in terms of cost and research expertise, and longitudinal 
questions on student outcomes are more difficult to address than cross-sectional questions on enroll- 
ment or the number of degrees awarded. Nonetheless, many community colleges attempt a better 
understanding of their students by: 

• Assessing student educational objectives; 

• Assessing student attrition - the causes of attrition and the extent to which 
attrition signifies student failure; 

• Assessing occupational outcomes; and 

• Assessing transfer outcomes. 



SoTcoUeJer '^"'^^''^^ ^"'^ ''""'^y Studies. American Association of Community and 



Sample research efforts in these four areas are descrihed below. They are meant as illustrative (though 

iTmited V.T'''^^ have worked within th pa 1^^^^^^^ 

limited research budgets to assess student goals and outcomes. F'lrameiers or 

Assessing Student Educational Objectives 

orLZTlTf/'"'^"''' '° community college research, because student outcomes are 

D Imv r^". °^ "''"'P''' ^^^"^f^^ will be extreme^ ow 

eo on tn'Jl h '"^^ °f ^" ^"--"-ty college studems wJo 

go on to ail bacca aureate-grantmg institutions. But higher transfer rates emerge when they are calculated 

accorrn^o tIe'° .th J f °' " 'T""'' ''"''"'y- ^^^^^^^ attainment rates wiH differ 

accordmg to the method of calculation: either as the percent of all enrolled students who obtain associate 
degrees or as a percent of students who enroll with the intention of earning an associate degree 



Glendale Community College 
Glendale, Arizona 



Glendale Communtiy College assesses the educational objectives of its students with a simple eieht 
Item questionnaire. In addition to soliciting information on student gender, age, ethnicity and nee7fo^ 
special assistance, financial or otherwise, the questionnaire asks- nnicity, and need for 



• Do you have work experience in your major 
field of study? 

□ Yes 

□ No 

• What is your primary educational goal in 
attending this college? 

□ Improvement of existing job skills 

□ Preparation r job to be obtained 

□ University transfer credit 

□ Personal interest 

• How do you expect to accomplish this goal? 

□ Selected courses only 

□ Certificate — less than one year 

□ Certificate — one year 

□ Certificate — two years 

□ Associate degree 

□ Complete apprenticeship requirements 

□ Other 



• If you are pursuing a formal program of 
study, what proportion of it do you expect 
to have completed by the end of this term? 

□ All 

□ More than half 

□ About half 

□ Less than half 

• Do you plan to enroll in this college in 
the future? 

□ Yes 

□ No 
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When this survey was administered to a sample of 3,352 students in 1985 the colleee fonnd rh.. o 
tT^S-T^'l^^ '"'IZ-^r Prima^'^^^tio': ^SngTn v^r it 

personal in fe^ nl u T.T^' ^^^""^ ^^''^ ^^^^ ^^^^ had enrolled to fulfill a 

studr and sTlS^ . h"^'"?' ^'^^ ^'^P^™"" - their major fields of 

re'a'rningfc^de^^^^^ ''''' '''' ^-'^ ''^ ^^-^ selected classes only with- 

H'n.'.'r i'"'^'"^' '""f implications for outcomes assessment. For exa.nple, the college might 
exp ct low overall transfer rates, given the small percentage of students indicating university creZ 

JuTv^T'T ^" '^^^ °f ^^"'^^"ts with work experience in 2 f^.ld o 

udy mdicatea that vocat.onal outcomes should be assessed in terms of job or career adv^cl nt n^^ 

To^^h M °^ P"^""' °^ ^''^'^^^'^ j^bs. For more information sec thTfuTl survev 

report by Montemayor and others. 1985. cited in accompanying bibliography ' ^ 



Vista College 
Berkeley, California 



those enroll? r °^ ''"'^'"'^ ^"'"^ questionnaire was small - just 

?mply a ked ''ZT '™'T ~ ''""^'""^ "^^^ "-'^^ « examj" one i em 

simpiy asked. What is your employment goal in the energy field?" 

Iere1mn'n?H°^'" ""''^'"^ '''''''^ ''"P^"^" ^howed that only 30 percent of the students 



Assessing Student Attrition 

up surveys Designed to disaggregate successful from unsuccessful leavers. 
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Los Rios Community College District 
Sacramento, Calfornia 

ll!!rl2.lT' u""! ^'"^^"'"'""""y College District surveyed former students, both graduates and 

Zv H ' ^^ ^''^ '"'"'^''^ °^ '^'^'"^•'^ F^" '982 or Spring 1983 ^"e 

sti^y sought mformafon on the former students' characteristics, prima:^ educational goals maTr 
programs of study, employment status, and reasons for not re-enrolling. On^ of the questionna^e "ems 

What was your PRIMARY reason for not re-enrolling at our college this semester? 

□ Completed associate degree or certificate □ Availability of courses was inadequate 
U Completed desired courses q Grade problems 

□ Transferred to another college q Dissatisfaction with quality of instr.ction 

□ Found or seekmg employment Q Dissatisfaction with content of courses 

□ Job hours conflict with school Q Personal/family reasons 
U Moved out of area/transportation problem Q Other 

□ College was too expensive 

failuief ;h''ernr°r '"'"f ''''' respondents could not be considered 

ta.lures. their pr mary reason for not re-enrolling was that they had completed the program or courses 
hey desired. This may be an artifact, however, of the low response rate a problem that plagues 

oZZ^l:^!^^^^^ '''''' of 'students thotT^^^^^^^^^^ 

; f ^ u T '^■ssat.sfaction with the college experience. For more information see the full 
study report by Lee. 1985. cited in the accompanying bibliography. 



Butler County Community College 
Butler, Pennsylvania 

lltl Community College provides another example of attrition research designed to assess the 

ZrT/ t'' ^^^^ '^^'y^' 'he 188 full-time students who w re 

enrolled in Fall 1984. Spring 1985. or Fall 1985 but who did not return in the following seirte 
Among other items, the questionnaire asked (in an open-ended fonnat): ^ 

• What was your original reason/goal for enrolling at BCCC? 

• Did you complete this goal? 

□ Yes 

□ No 

If no, why? 

Because BCCC was working with a relatively small group of students and employed telephone follow- 
ups o reach nonrespondents. 80 percent of the students were contacted. The findings were mixed- 
while many students met their goals, others did not. citing reasons such as pregnancy or a move ^o a 
d. ferem location. In these latter cases, attrition was the result of personal problems or life change no 
academic failure. For more information, see the full study report by OIszak-McCIaine. 1986 cited in 
the accompanying bibliography. li/oo. ciiea m 
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Assessing Occupational Outcomes 

measure J Mow.„pf„ sTf^LZ 3 o^^^^^^^^ -"'--S -his 

fn°dLrzSetb%:r"iT'rr^^^^^^^ Tr--^^ °' ^'^-^ 

co.es crbe Jbu,ed ,„ v^afe^lfe ^op^sS^^^^^^^^^ ou,- 
Also, most surveys are condncteH nn a « \ 7^°*^ '° '"^ ^'^'^^n' ^ prior employment experience. 

view' of the student" c^e ves L fof rl 7 T f'" '° P™^''^^ ^ '-g-'^- 

estimatesof lifetime ea^tss a^d do rate-of-retum analyses, they are based on questionable 

But as the fXw ng exZTe showf ^1^^ nonpecuniary benefits that accrue to students. 

outcomesbyre;i:|ormt:ta:g^^^^^^^^^ 



William Rainey Harper College 
Palatine, Illinois 

admittedly rough but nonetheless valid indicator o^L ecotmic he" 'T'^' ^'t 

community college vocational cl««^« c« i economic benefits accrued to those who take 

cited in thl f^o"^ information, see the study report by Lucas 1984 

cited m the accompanymg bibliography. ^ 



Assessing Transfer Outcomes 

s?bTe7:?acSic'*~it^^^^^ °f ™« " f°-y- colleges and ,h= 
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San Mateo County Community College District 
San Mateo, California 

lLn>% '""'^"''^'^ Community College District to assess the 

distnct s effectiveness .n transfer education. Besides surveying the.r students to determine the propor- 
tion who planned to transfer to four-year colleges and universities, data from other sources were 
gathered and exammed with respect to: 

• The flow of district transfers to the University of California (UC) and to the California 
State Uriiversity (CSV) system; 

• Comparison of the declining number of San Mateo County high school seniors with 
declines in the number of SMCCCD transfers to UC and CSU; 

• Comparison of the ethnicity of district transfers with the ethnicity of district 
freshmen who are 19 or younger; and 

• First-year academic performance of district transfers to UC and CSU. 

Thus, the district's study was informed not only by indicators of student flow to four-year colleges but 
by an assessment of factors that affect that flow, such as the rise and fall of the pool of available high 
school graduates. For more information, see the full study resport by Young. 1985. cited in the accom- 
panying bibliograpny. 



Piedmont Virginia Community College 
Charlottesville, Virginia 



At Piedmont Virginia Community College, researchers utilized a value-added approach to assess the 
college s effectiveness in preparing students for transfer to the University of Virginia. The academic 
performance of 500 community college transfers was compared with the academic performance of 

wTrfh ."'"^ °i ^'^'"'^ ''"'^y ^"""'^ ^^"'l^"^^ P^rfonned comparably 

with the native students in terms of upper-division grades and graduation rates. But the researchers also 

'tu^rf V"" °^ '''""y *^ °f fr^hman matriculation, finding 

that the transfer sti:dents .nuially came to college with significantly lower SAT scores and high school 
grades. The conclusion: "Community college transfer students travelled a greater distance on their 
collegiate journey than did their university counterparts. Somewhere along the way. these students 
overcame their lower test scores so that they performed well, not only at the community college but 
after transferring to the university." For more information, see the study cited below 
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